Efficient unconstrained black box optimization

نویسندگان

چکیده

Abstract For the unconstrained optimization of black box functions, this paper introduces a new randomized algorithm called . In practice, matches quality other state-of-the-art algorithms for finding, in small and large dimensions, local minimizer with reasonable accuracy. Although our theory guarantees only minimizers heuristic techniques turn into an efficient global solver. very thorough numerical experiments, we found most cases either minimizer, or where could not be checked, at least point similar to best competitive solvers. smooth, everywhere defined it is proved that, probability arbitrarily close 1, basic version finds $${{\mathcal {O}}}(n\varepsilon ^{-2})$$ O ( n ? - 2 ) function evaluations whose unknown exact gradient 2-norm below given threshold $$\varepsilon >0$$ > 0 , n dimension. smooth convex case, number improves {O}}}(n\log \varepsilon ^{-1})$$ log 1 (strongly) case n\varepsilon This known recent complexity results reaching slightly different goal, namely expected Numerical show that effective robust comparison solvers on test problems Gould et al. (Comput Optim Appl 60:545–557, 2014) Jamil Yang (Int J Math Model Numer 4:150, 2013) 2–5000 variables.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ROCK∗ - Efficient black-box optimization for policy learning

Robotic learning on real hardware requires an efficient algorithm which minimizes the number of trials needed to learn an optimal policy. Prolonged use of hardware causes wear and tear on the system and demands more attention from an operator. To this end, we present a novel black-box optimization algorithm, Reward Optimization with Compact Kernels and fast natural gradient regression (ROCK). O...

متن کامل

Efficient Global Optimization of Expensive Black-Box Functions

In many engineering optimization problems, the number of function evaluations is severely limited by time or cost. These problems pose a special challenge to the field of global optimization, since existing methods often require more function evaluations than can be comfortably afforded. One way to address this challenge is to fit response surfaces to data collected by evaluating the objective ...

متن کامل

Efficient Surrogate Assisted Optimization for Constrained Black-Box Problems

Modern real-world optimization problems are often high dimensional and subject to many constraints. These problems are typically expensive in terms of cost and computational time. In order to optimize such problems, conventional constraintbased solvers require a high number of function evaluations which are not affordable in practice. Employment of fast surrogate models to approximate objective...

متن کامل

An Efficient Conjugate Gradient Algorithm for Unconstrained Optimization Problems

In this paper, an efficient conjugate gradient method for unconstrained optimization is introduced. Parameters of the method are obtained by solving an optimization problem, and using a variant of the modified secant condition. The new conjugate gradient parameter benefits from function information as well as gradient information in each iteration. The proposed method has global convergence und...

متن کامل

A A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization

This paper proposes a competitive divide-and-conquer algorithm for solving large-scale black-box optimization problems, where there are thousands of decision variables, and the algebraic models of the problems are unavailable. We focus on problems that are partially additively separable, since this type of problem can be further decomposed into a number of smaller independent sub-problems. The ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematical Programming Computation

سال: 2022

ISSN: ['1867-2957', '1867-2949']

DOI: https://doi.org/10.1007/s12532-021-00215-9